A Verbal Interaction Measure Using Acoustic Signal Correlation for Dyadic Cooperation Support
نویسندگان
چکیده
We introduce a method for detecting whether two users are engaged in focused interaction using a windowed correlation measure on their acoustic signals, assuming that a continued exchange of verbal turns contributes to anticorrelation of acoustic activity. We tested our method with manually annotated transitions between focused and unfocused interaction stemming from experiments on AR-based cooperation within a research project on alignment in communication. The results show that a high degree and extended duration of speech activity anticorrelation reliably indicates focused interaction, and might thus be a valuable asset for situation-aware technical systems.
منابع مشابه
A Comparative Study of Gender and Age Classification in Speech Signals
Accurate gender classification is useful in speech and speaker recognition as well as speech emotion classification, because a better performance has been reported when separate acoustic models are employed for males and females. Gender classification is also apparent in face recognition, video summarization, human-robot interaction, etc. Although gender classification is rather mature in a...
متن کاملUsing Informal Conversation in the Clinical Setting as a Measure of Communication Potential for Adults with Aphasia
The purpose of this study was to investigate the clinical usefulness of informal conversation as a tool for determining ability to communicate potential regardless of modality (verbal or nonverbal). Four individuals with aphasia (two non-fluent and two fluent) and four non-impaired individuals participated in this study. Selected segments of conversational discourse were analyzed for communicat...
متن کاملAcoustic correlated sources direction finding in the presence of unknown spatial correlation noise
In this paper, a new method is proposed for DOA estimation of correlated acoustic signals, in the presence of unknown spatial correlation noise. By generating a matrix from the signal subspace with the Hankel-SVD method, the correlated resource information is extracted from each eigen-vector. Then a joint-diagonalization structure is constructed of the signal subspace and basis it, independent...
متن کاملThe Language of Interpersonal Interaction: An Interdisciplinary Approach to Assessing and Processing Vocal and Speech Data
Verbal and non-verbal information are central to social interaction between humans, and have been studied intensively in psychology. Especially, dyadic interaction settings (e.g, between romantic partners or between psychotherapist and patient) are relevant for a number of psychological research areas. However, psychological methods applied so far have not been able to handle the vast amount of...
متن کاملMultimodal Cognitive Nonverbal and Verbal Interactions: the Neurorehabilitation of Autistic Children Via Mobile Toy Robots
Multimodal cognitive nonverbal processes could be thought as a building block from which emotional and verbal expressions could emerge. With the intention to explore this hypothesis, we studied the interaction between autistic children and mobile toy robots during free spontaneous game play both quantitatively and qualitatively. Cognitive nonverbal criteria (eye contact, touch, manipulation, an...
متن کامل